On Tuning Hyper-Parameters of Multiclass Margin Classifiers
نویسندگان
چکیده
Abstract. The choice of hyper-parameters (e.g. kernel parameters) can significantly affect generalization performance of large margin classifiers. In this paper we are concerned with the problem of tuning these values in the case of multi-class problems that have been recast into a set of binary problems. We report several experimental results comparing independent and joint tuning of the hyper-parameters of the binary classifiers. Several different encoding strategies are explored, including error correcting output codes. Tuning was carried out by using a validation set and a newly introduced bound on the leave-one-out error.
منابع مشابه
Multi-Resolution Cascades for Multiclass Object Detection
An algorithm for learning fast multiclass object detection cascades is introduced. It produces multi-resolution (MRes) cascades, whose early stages are binary target vs. non-target detectors that eliminate false positives, late stages multiclass classifiers that finely discriminate target classes, and middle stages have intermediate numbers of classes, determined in a data-driven manner. This M...
متن کاملFrom Margins to Probabilities in Multiclass Learning Problems
Abstract. We study the problem of multiclass classification within the framework of error correcting output codes (ECOC) using margin-based binary classifiers. An important open problem in this context is how to measure the distance between class codewords and the outputs of the classifiers. In this paper we propose a new decoding function that combines the margins through an estimate of their ...
متن کاملLarge Margin DAGs for Multiclass Classification
We present a new learning architecture: the Decision Directed Acyclic Graph (DDAG), which is used to combine many two-class classifiers into a multiclass classifier. For an -class problem, the DDAG contains classifiers, one for each pair of classes. We present a VC analysis of the case when the node classifiers are hyperplanes; the resulting bound on the test error depends on and on the margin ...
متن کاملMulticlass classification with potential function rules: Margin distribution and generalization
Motivated by the potential field of static electricity, a binary potential function classifier views each training sample as an electrical charge, positive or negative according to its class label. The resulting potential field divides the feature space into two decision regions based on the polarity of the potential. In this paper, we revisit potential function classifiers in their original fo...
متن کاملConvex Optimization for Binary Classifier Aggregation in Multiclass Problems
Multiclass problems are often decomposed into multiple binary problems that are solved by individual binary classifiers whose results are integrated into a final answer. Various methods, including all-pairs (APs), one-versus-all (OVA), and error correcting output code (ECOC), have been studied, to decompose multiclass problems into binary problems. However, little study has been made to optimal...
متن کامل